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Abstract 

Non-dominated sorting arranges a set of points in n-dimensional Euclidean space into 
layers by repeatedly removing the coordinatewise minimal elements. It was recently shown 
that nondominated sorting of random points has a Hamilton-Jacobi equation continuum 
limit. The obvious numerical scheme for this PDE has a slow convergence rate of 0(h"). 
In this paper, we introduce two new numerical schemes that have formal rates of 0{h ) 
and we prove the usual 0(y/h) theoretical rates. We also present the results of numerical 
simulations illustrating the difference between the formal and theoretical rates. 


1 Introduction 

In this paper, we introduce new finite difference schemes for the Hamilton-Jacobi equation 

«*i"- = / in R + ) (1 ^ 

u = 0 on <9M™,J 

and prove rates of convergence. 

The Hamilton-Jacobi equation (II. 1 j) appeared recently as the continuum limit of nondom¬ 
inated sorting, which is widely used in scientific and engineering contexts [5]. Let us briefly 
describe the connection. Let X\ ,..., Vyr be i.i.d. random variables on with continuous 
density /. Let T\ denote the elements in S := {Xi,.. ., AJv} that are coordinatewise minimal. 
The set J-\ is called the first Pareto front of S , and the elements of J-\ are called Pareto optimal 
or nondominated. The second Pareto front, denoted T- 2 , is the set of minimal elements from 
S\J-\, and the k th Pareto front is defined as 

Afc = Minimal elements of S \ [^J Jy. 

i<k 
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(a) i.i.d. samples (b) N = 10 4 samples (c) N = 10 6 samples 


Figure 1: A simulation illustrating that ED is the continuum limit of nondominated sorting. 
The distribution of X ±,..., Xjy is depicted in (a). In (b) we show 25 of the nondominated 
layers obtained by sorting N = 10 4 i.i.d. samples, and in (c) we compare the layers for N = 10 b 
samples against the level sets of the viscosity solution of ED- 


The process of sorting the set S into Pareto fronts, or nondominated layers, is called non¬ 
dominated sorting, and is widely used in multi-objective optimization (see m\ and references 
therein), with recent applications to machine learning |14H16| . It turns out that nondominated 
sorting is equivalent to finding the longest chain in a partially ordered set, which has a long 
history in probability and combinatorics It was shown in [5] that the 

Pareto fronts converge almost surely in the limit as N —>• oo to the level sets of the unique 
nondecreasin^] viscosity solution of (11.11) . Figure [Q gives an illustration of this continuum 
limit. 

In [6], a fast algorithm called PDE-based ranking was proposed for approximate nondomi¬ 
nated sorting of large datasets. The basic idea is to estimate the density / from a (relatively 
small) subset of X\, ..., Xjy, and then use the numerical solution of the Hamilton-Jacobi equa¬ 
tion ED as an approximation of nondominated sorting. It was shown in [6] that PDE-based 
ranking is substantially faster than nondominated sorting in relatively low dimensions, while 
maintaining high levels of sorting accuracy. The numerical scheme for (11.11) used in [6] is based 
on backward finite differences and can be solved very efficiently in a single pass. Due to the 
fact that information flows along coordinate axes in the definition of nondominated sorting, 
this scheme is upwind (or monotone), and convergence of the scheme was established in [6]. 

Although the scheme used in [6j is simple and efficient, it suffers from poor accuracy, with 
formal rates of convergence on the order of O(h^) for a grid with spacing h > 0 in dimension 
n. In this paper, we propose two new and highly efficient finite difference schemes for solving 
EE Both schemes have a formal accuracy of 0(h ) when the solution is smooth, and we prove 
the usual 0(Vh ) rates in the context of non-smooth viscosity solutions. These schemes can 
be used to increase the accuracy of PDE-based ranking [6] without increasing computational 
complexity. Alternatively, with these highly accurate schemes we can afford to use a coarser 
grid resolution, and thus we can reduce the computational complexity of PDE-based ranking 
while maintaining high accuracy. This is particularly important in applications of nondom¬ 
inated sorting [9j[m]T6j, which will benefit from highly accurate and efficient algorithms for 
sorting massive datasets. We detail the new schemes and our main results in the next section. 

4 We say that u : ft C R n —> R is nondecreasing if Xi i-r u(x) is nondecreasing for all i. 
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1.1 Main results 

We pose the Hamilton-Jacobi equation (11.11) on a compact domain as follows: 


{u xl ) + ---{u Xn )+ = f in (0, l] r 
u = 0 on T, 


(PI) 


where T := <9[0, l] n \ (0, l] n and a_|_ := max(a, 0). Notice we have modified (11.11) by taking the 
positive parts of the partial derivatives. This is necessary to obtain existence of a viscosity 
solution of ED, and is a well-known issue with viscosity solutions on boundaries of domains 
(see 0 )- We elaborate on this briefly in Section 0 We should mention that there is no loss 
of generality in considering the domain [0, l] n in (IP 11) . Indeed, we can make a simple scaling 
argument to transform the domain of ED into n?=i[o , Xi\ for any x € R". 


Let h > 0, Z/j = {hk : k € Z}, and ZJJ = (Z h) n . For 12 C 
the numerical scheme for (IP1I) from [6]: 


set ilh = 12 n Zf\ We recall 


(D 1 u h (x))+ ■■■(D n u h (x))+ = f(x) if x € (0,1]£ 
u h (x) = 0 if x € T h , 


(SI) 


where Uh : [0,1]^ —> R is the numerical solution and 


Dfu h {x) = ± 


u h (x ± hej ) - u h (x) 
h 


The solution Uh of (IS1I) can be solved efficiently in a single pass, which is reminiscent of the fast 
marching m and fast sweeping |22| algorithms. In dimension n = 2, the scheme is quadratic 
and can be solved in closed form 

u h (x)= 1 -^- - /?ei ) + Uh ( x — + ^-y/(u h (x - hei) - u h (x - he 2 )) 2 + 4:h 2 f (x) 2 . (1.2) 

In dimensions n > 3, the scheme can be solved via any iteration method, such as a bisection 
search. Convergence of (IS1I) to the viscosity solution of (IPID was established in [6|. 

While (IS1D is optimal in terms of computational complexity on a fixed grid, its accuracy is 
at best 0(h,n). To see this, consider the special case of / = 1 and u(x) = n[x i • • • x n )™. The 
solution u is smooth on (0, l] n , and has a gradient singularity on the boundary T. We can use 
the comparison principle [6J for ( IPID to show that in general 

n(xi • • • x n )" inf /« < u(x) < n(x i • • • x n )™ sup /«. 

[0,1]^ [o,i]— 

Therefore, the gradient singularity on T is typical for solutions of ED whenever inf[ 0 ,l]«■ / > 0. 
Let cp(x) = Cn(xi ■ ■ ■ x n )n. By the concavity of c p 

D~tp(x) > <p Xi (x) = C(x i • ■■Xn^xJ 1 . 

On the other hand, if Xj = h then 

D~<p{x) = = Cn(x i • • • Sn)"^" 1 . 


3 






Therefore, for any x € (0,1]JJ such that Xi = h for some i we have 


Setting C = n 


D\ <p(x)---D n <p(x) > nC n . 

~n and invoking the comparison principle for (IS 11) yields 
Uh(x) < <p(x) = n 1_ ™ (x\ ■ ■ ■ x n )™ whenever x, = h for some i. 


Letting x = (h, 1,... , 1) we find that 

Uh(x) < = u(x) — n{ 1 — n~n)hn. 

Therefore, the scheme (IS 1 1) makes an error on the order of 0(h n) in the immediate vicinity of 
the boundary T. Since u is generally not smooth, the best theoretical rate that one can prove in 
the context of viscosity solutions is typically strictly worse than the formal rate (see EEM). 
In Section [5] we show numerical results indicating that the i°° convergence rate of O(h^) is 
typically observed in practice. 

Since the slow convergence rate is caused by a singularity in the gradient of u on T, it is 
natural to look for a transformation of u that removes this singularity. With this in mind, 
we set v = u n /n n where u is the nondecreasing viscosity solution of (IP1I) . When / = 1 we 
have v(x) = x\ ■ ■ ■ x n , which is Lipschitz continuous (in fact smooth) on [0, l] n . In general, we 
prove in Lemma f4. 101 that v € C 0,1 ([0,1]”) whenever /« € C' o,1 ([0, l] n ). Furthermore, v is a 
viscosity solution of 

(vx 1 )+--(v Xn ) + = v n ~ 1 f in (0, l] n l 
v = 0 on T. 

Since v is Lipschitz continuous, it is reasonable to suspect that a numerical scheme for (lP2j) 
would have a better convergence rate than (IS1D . We therefore propose the following finite 
difference scheme for (1P2I) : 


(D 1 v h (x)) + ---(D n v h (x)) + = v h (x) n 1 f(x) if x <5(0,1]J*1 
v h (x)=0 if x € T h , J 

where Vh ■ [0,1])( — >• R. We take Vh(x) to be the largest solution of (IS2D at each x € (0,1]JJ. It is 
interesting to note that when / is constant, the solution of the scheme (1S2[) is Vh(x) = cx,\ ■ ■ ■ x n , 
which is the exact solution of (IP2|) . 

The scheme can be solved efficiently in a single pass, similar to (IS1I) . and in dimension 
n = 2 we have the closed form expression 

Vh(x) = — + ^ +7jV B2 + %h 2 f(x)A + h 4 /(x) 2 , (1.3) 

where 

A = Vh (x — he i) + Vh(x — he 2 ) and B = Vh (x — he 1 ) — Vh{x — he 2 ). 

In Theorem 13.61 we prove convergence of (1S2I) when / is continuous and nonnegative. Our 
main result is the following convergence rate. 
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Theorem 1.1. Suppose f G C 0,1 ([0, l] n ) and f > 0. Let Vh be the solution of (1S2I) and let u 
be the nondecreasing viscosity solution of (IP1I) . Then 

\n n Vh(x ) — u(x ) n | < Cy/h for all x G [0, Iff, (1-4) 


and 

| nvh(x)™ — u(x)| < C5 1 ~ n Vh for all x G [<5, Iff, (1.5) 

where 5 > 0 and C = C(n, [/]i ; [o,i]"> inf[ 0 , 1 ]^ /) • 

Notice that (IP2() has a zeroth order term with the wrong sign for comparison principle 
arguments to hold. We can see this by observing that the method of vanishing viscosity takes 
the form 

v xi ■■■v Xn - eAv = v n ~ l f. 


Since the standard proof of convergence rates for numerical approximations to viscosity so¬ 
lutions is based on the proof of the comparison principle |8l fl0lfl9] . we cannot directly apply 
these techniques to (1S2I) . 

Our proof of Theorem 11.11 passes through an auxiliary problem, which actually suggests 
another numerical scheme for solving m Based on our observation that u(x) = n(x\ ■ ■ ■ x n ) ™ 
is the viscosity solution of ED corresponding to / = 1, it is natural in more general settings 
to make the ansatz 


u(x) 



( 1 . 6 ) 


for some function w : [0, l] n —>• [0, 00 ). If this ansatz is correct, then w would be a viscosity 
solution of 

n 

JJ(u; + nxiW Xi ) + = f on (0, l] n . (P3) 

1=1 

It turns out that (IP3I) is well-posed within the class of bounded viscosity solutions without 
imposing a boundary condition. The boundary condition is actually encoded into the PDE 
due to the fact that the term nXiW Xi vanishes on T n {xi = 0}. This suggests, for example, 
that we should expect w(0) = /(0)™. Due to the degeneracy of the terms nXiW Xi , there are 
in general infinitely many unbounded viscosity solutions of (IP3p . We characterize w from 
(ED as the maximal bounded viscosity solution of (1P3|) , and we show in Lemma 14.81 that 
w G C' o,1 ([0, l] n ) whenever fn G ^^([O, l] n ). 

We propose the following numerical scheme for flP3l) : 


(w h (x) + nx i D i w h (x)) + = f(x) for all x G [0,1]£, (S3) 

1=1 

where Wh ■ [0, Iff —>■ [0,oo). Here, we take Wh(x ) to be the largest solution of (lS3l) at each 
x G [0, Iff. We note that for x G [0, l]f such that X{ = 0, the quantity D~Wh{x ) is undefined. 
Since this term appears in the form nXiD~Wh(x), its value is not used in the scheme (1S3|) . 
It is interesting to note that when / is constant, the scheme (1S3|) gives the exact solution of 


This scheme can be solved efficiently in a single pass, and in dimension n = 2 the scheme 
can be solved in closed form 

w h {x) = C + \JD 2 + (2xi + h)(2x 2 + h)h 2 f(x), (1.7) 
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where 


C = x\{2x2 + h)wh(x — he i) + £ 2 ( 2 x 1 + h)wh(x — he 2 ) 


and 

D = xi(2x2 + h)wh(x — he 1 ) — ®2(2xi + h)wh(x — he 2 ). 

Since the zeroth order term in (1P3I) has the correct sign, we can use a modification of the 
standard convergence proof to establish the following convergence rate. 

Theorem 1.2. Suppose that f € C'°’ 1 ([0, l] n ) and f > 0. Let uih be the solution of (lS3h . and 
let w be the maximal bounded viscosity solution of (1P3I) . Then 

\w(x) — w h {x)\ < CVh for all x € [0, Iff, (1.8) 

where C = C(n, [/] 1; [ 0)1 ]«, inf [0>1] n /). 

Our proof of Theorem 11.11 proceeds by first showing (in Lemma 14.1311 that 

\xi... x n w h (x) n - v h (x)\ < Ch , 
and then invoking Theorem 11.21 

Although both ()S2I) and f lS3j) have the same provable convergence rates, our numerical re¬ 
sults presented in Section [5] suggest that in general (1S2I) has a better experimental convergence 
rate than (1S3D . This can be explained by observing that u can only have gradient singularities 
when transitioning from zero to a positive value. The transformation v = u n /n n regularizes 
these gradient singularities anywhere in the domain [0,1]", and not just on the boundary T. 
On the other hand, the transformation w(x) = n~ 1 (xi • • • x n )~^u(x) is designed only to cap¬ 
ture singularities on the boundary T. In Section [5l we give an example of a discontinuous 
function / for which (1S2|) exhibits a better convergence rate than (|S3|) for the reason outlined 
above. 

This paper is organized as follows. In Section^ we prove comparison principles for viscosity 
solutions of (1P2I) and (1P3D . In Section [3l we use the Barles-Souganidis framework [2] to prove 
convergence of the schemes ()S2l) and ( 1S3I) under the assumption that / is continuous and 
nonnegative. In Section [4] we prove Theorems 11.11 and 11.21 establishing rates of convergence for 
(1S2|) and (1S3I) when / is positive and Lipschitz. The proofs of the convergence rates require 
Lipschitz estimates for the viscosity solutions of (1P2D and (IP3I) . These are obtained in Section 
14.2.11 In Section [5] we show the results of numerical simulations comparing all three schemes. 


2 Some comparison principles 


We first prove comparison principles for (IPTT) (1P31) that will be utilized later in the convergence 
proofs. Let us first briefly comment on the differences between (IPTT) and (11.11) . As we mentioned 
in Section EH it is necessary to modify (jl.ll) by taking the positive parts of u xi ,..., u Xn when 
posing the PDE on compact domains. To see why this is necessary, consider (IP 11) with / = 1 
in dimension n = 2 without this modification: 


'U j x\'U , X2 


= 1 


u = 0 


in (0,1] 2 1 
on r. 


( 2 . 1 ) 
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This Hamilton-Jacobi equation of course has a classical solution u{x) = c l^Jx\X 2 that is smooth 
on (0, l] 2 . However, u is not a viscosity solution of (12.11) . To see this, let ip(x) = — t(x± + X 2 ). 
Then u — <p has a local maximum at x = (1,1) relative to (0, l] 2 for every t > 0. Since 

<p xl (l,l)<p X 2 (l,l)=t 2 > f(l,l) 

for t > a//( 1,1), the viscosity subsolution property fails to hold at x = (1,1). This is a 
well-known issue with viscosity solutions on boundaries of domains (see Cl)- Notice, however, 
that 

(¥’xi(M))+(¥>s 2 (M))+ = 0 < /(1,1) for all t > 0. 

Taking the positive parts of u xi ,..., u Xn in m gives the PDE a useful monotonicity 
property that we will exploit in this paper. Since it is useful to abstract this property, we 
make the following definition. 

Definition 2.1. Let s < 1. We say H : (s, l] n x R x W 1 —>• R is directed if for all (x,z) € 
(s, l] n x R 

p i—^ H(x,z,p) is nondecreasing. (2-2) 

If H is directed, it is simple to construct a monotone (or upwind) numerical scheme using 
backward difference quotients. Indeed, let us consider the scheme 

H(x,u h (x),D~u h (x)) = 0 in (s, 1]£, (2.3) 


where Uh '■ [s, —)• R and 


D u h (x) = (D 1 u h (x),... ,D n u h (x)). 

To see that (12.31) is monotone, suppose that u(x o) = v(xq) and u(x) > v(x) for x € [s,l]JJ. 
Then D~u(x o) < D~v(x o) for all i € {1,... ,n}, and since H is directed 

H(x,u(x),D~u(x)) < H(x,v(x), D~v(x)). 


The following Theorem is a direct consequence of this monotonicity and pj Theorem 2.1]. 


Theorem 2.2. Suppose that H is continuous and directed. Let {uh}h >o be solutions of (12.3(1 
satisfying 


sup \uh(x)\ < oo. 
h> o 
xe[s,i]^ 


Then 


u(x) = liirisup Uh{y) ( resp. ufx) = liminf Uh(y)) 
o 

y—tx y—* x 


is a viscosity subsolution (resp. supersolution) of H = 0 in (s, l] n . 


When / E C'([0,oo) n ), there is a unique nondecreasing viscosity solution u of (11.11) [3]. We 
now show that the restriction of u to [0, l] n is the unique nondecreasing viscosity solution of 
(ED. This establishes the equivalence of ED and ED- 
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Lemma 2.3. Suppose f £ C([0, l] n ) is nonnegative. Let u £ USC([ 0, l] n ) be a viscosity 
subsolution of (ED, and let v £ LSC([ 0, l] n ) be a nondecreasing viscosity supersolution of 
ED. Then u < v on [0, l] n . 

Proof. Let A > 0 and set v\ = v + A(xi + • • • + x n ). Since v is nondecreasing, v\ is a viscosity 
solution of 

( u A,*i)+ • • • {v x , Xn )+ > f + A n on (0, l] n . 

The standard comparison argument based on doubling the variables (see HI El) shows that 
u < v\ on [0, l] n . Sending A —>• 0 completes the proof. □ 

Lemma 2.4. Let f £ C([0, oo) n ) be nonnegative and let u be the nondecreasing viscosity 
solution of ED. Then the restriction of u to [0, l] n is the nondecreasing viscosity solution of 

ED- 

Proof. By Lemma [0. Lemma 3.3], the numerical solutions Uh of (IS1I) satisfy the estimate 

I u h (x) - u h (y)\ < C(\x - y\n + hn) 

for all x,y € [0,1])], where C = C(n, sup^^n /). Combined with Theorem 12.21 this shows 
that Uh converges uniformly on [0, l] n to the unique nondecreasing viscosity solution of flPH) . 
By Theorem 3.4], we also have Uh —>■ u uniformly on [0, l] n , which completes the proof. □ 


2.1 The HJ-equation (1P2h 

In this section, we establish a comparison principle for (1P2D . When / € C([0, l] n ), the function 
v = u n /n n is a nondecreasing viscosity solution of (1P2I) (see Lemma 12.51) . We will call v = 
u n /n n the maximal viscosity solution of (1P2[) (see Lemma m- 

Since ()P2ft has a zeroth order term of the wrong sign for comparison to hold directly, we 
find that (1P2[) actually has infinitely many nondecreasing viscosity solutions. 

Lemma 2.5. Let / £ C([0,1]™) be nonnegative, let y £ [0, l\ n , and let u be the nondecreasing 
viscosity solution of 


(^£ 1 )+ ‘'' ( u x n )+ — ,/ 


u = 0 


n 

in 1 ] 

i— 1 

n n 

on 1 ] \ Y[{yi, 1 ], 

i=1 i —1 


(2.4) 


and extend u to [0, l] n by setting u{x ) = 0 for x € [0, l] n \ HILi [hii !]■ Then v = u n /n n is a 
nondecreasing viscosity solution of (IP2I) . 

Proof. Let xq € (0, l] n and let ip £ C 1 ([0, l] n ) such that v — ip has a local maximum at xo- 
We also assume that p(xq) = v(xq). If v(xq) = 0 then since u is nondecreasing, we see that 
v(x) = 0 for all x that are coordinatewise less than xq. It follows that <p Xi (xo) < 0 for all i, 
and the subsolution property is trivially satisfied. If v(xq) > 0, then u(x 0 ) > 0 and therefore 
x 0 € ns=i(w.i]- Setting if(x) = np(x)n we find that u — has a local maximum at xq. 
Therefore 

W’xi(*o))+ '' • (^*„(®o))+ < /(*o)- 
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Since <p{x o ) = v(xq) > 0, this becomes 


(^x! (zo))+ • • • {<p Xn (®o))+ < v(x 0 ) n 1 f(x o), 


which verifies the subsolution property. The proof of the supersolution property is similar. □ 

The lack of uniqueness of nondecreasing viscosity solutions of (1P2I) indicates that we cannot 
expect a comparison principle to hold for arbitrary sub- and supersolutions of (1P2[) . However, 
we show in the following lemma that every subsolution is bounded above by v = u n /n n . This 
turns out to be sufficient to prove convergence of (IS2I) . 

Lemma 2.6. Let f € P([0, l] n ) be nonnegative and let v € USC([Q, l] n ) be a nonnegative 
viscosity subsolution of (IP2D . Then v < u n /n n on [0, l] n , where u is the nondecreasing viscosity 
solution of ED- 

Proof. We define u\ = nv «. Let xq € (0, l] n and ip € P 1 ([0, l] n ) such that u\ — ip has a local 
maximum at xq and <p{x o) = ui(a:o). Letting if(x) = (p(x) n /n n , we see that v — if has a local 
maximum at xq and therefore 


Oxi(To))+ • • • Ox„(To))+ < v(x 0 ) n 1 f(x 0 ). 


Since Dif(x q) 


n— i . 

v(xq) « D<p( xq), we have 


v(x 0 ) n 1 ((p Xl (x 0 ))+ ■ ■ ■ (<p Xn (x 0 ))+ < v(x 0 ) n 1 f(x 0 ). 


If v(xq) > 0 then 


(<AnOo))+ • • • (<Px n (x o))+ < fix 0 ). 


(2.5) 


If v(xo) = 0, then since v is nonnegative, <p Xi (x o) < 0 for all i, which verifies (12.5jl . By Lemma 
12.31 u\ < u, where u is the unique nondecreasing viscosity solution of (IPII) . □ 


2.2 The HJ-equation (1P3I) 

Before establishing a comparison principle for (IP3I) . let us comment on the properties of 
solutions of (IP3I) . Let / € C([0, l] n ) be nonnegative and let u be the nondecreasing viscosity 
solution of (IP 1 1) . By Lemma [2.31 we have 

0 < u(x) < n(x i • • • x n )™ sup fn for all x € (0, l] n . 

[o,i ] n 

Setting w(x) = n~ l {x\ ■ ■ ■ x n )~^u(x) € C((0, l] n ) we have 

0 < w(x) < sup fn for all x € (0, l] n . 

[ 0 , 1 ]" 

We also have that w is a viscosity solution of (IP3I) that satisfies 

w + nxiW Xi > 0 on (0, l] n (2-6) 

in the viscosity sense for all i. To see this, let xq € (0, l] n and tp € C 1 ((0,1]”) such that 
w — p has a local minimum at xq. We can also assume p>(xq) = w(xq), so that w > (p in a 
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neighborhood of x 0 . Setting ip(x) = n(x i • • • x n )”tp(x) it follows that u > ip in a neighborhood 
of xo and u(x o) = ip(x o). Therefore u — ip has a local minimum at xo- Since u is nondecreasing, 
ifixiix o) > 0 for all i and 

ipxiix o) • --ipxnix o) > f{x o). 

A simple computation shows that 

n 

J(w(xo) + nxi<p Xi (x 0 )) > /(x 0 ), 

i =1 


and 

w(x o) + nxnp Xi (x o) > 0 for all i. 

The subsolution property is verified similarly. We will call w the maximal bounded viscosity 
solution of (IP3I) . 

Notice the boundary condition u = 0 on T is only used to show that w is bounded. Indeed, 
it is clear that the argument above holds when u is any viscosity solution of 


(u xl ) + ---(u Xn )+= f in (0, l] n . 

This yields an infinite number of unbounded viscosity solutions of (IP.31) . For instance, when 
/ = 1 the function 

n 

w(x) = + Cxp 1 )™ 

2—1 

for any C > 0 is a viscosity solution of (IP3I) . Taking C = 0 gives the bounded viscosity 
solution of interest from (11.61) . The following theorem characterizes this solution as the unique 
bounded viscosity solution of (1P3|) satisfying (12.61) . 

Theorem 2.7. Assume that f € C([0, l] ra ) is nonnegative. Let w\ € USC((0, l] n ) and W 2 € 
LSC(( 0, l] n ) be bounded viscosity sub- and supersolutions of (1P3[) . respectively, and suppose 
that W 2 satisfies ( 12 . 61 ) in the viscosity sense for all i. Then w\ < W 2 on ( 0 , l] n . 

Proof. For i = 1,2, we define 

)n(xi---x n )nwi(x), if x € (0, l] n 
Ui(X) = < 

\o, ifxeT. 

Since w\ € USC((0, l] n ) is bounded, u\ € USC([0, l] n ). Similarly, U 2 € LSC([0, l] n ). 

We first show that U 2 is a nondecreasing viscosity supersolution of (IP1I) . Let y G (0, l] n 
and ip € C' 1 ((0,1]”) such that U2 — <p has a local minimum at y and v,2{y) = p{y)- We define 

^(x) = - ^ 1 for x € (0, l] n . 

n(xi• • -x n )n 

Then it follows that u >2 — ip has a local minimum at y. Since W 2 is a viscosity supersolution 
of (IP3I) we have 

n 

n( W2 (y) + n Vi' l l’x i {y))+ > f(y)- (2.7) 

2 — 1 
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Since 


1>xi(y) 


and w 2 satisfies (12.6p we have 


VxjW 

n(yi■■■y n )« 


w 2 (y) 

nyi 


0 < w 2 (y) + nyiip Xi (y) 


yi<Pxj(.y) 

{yi •• -yn)™ 


Therefore <p Xi {y) > 0 for all i and 


TxAv) ■ ■ ■ <Px n (v) > f(y)- 

This establishes that u 2 is a nondecreasing (e.g., see [H Lemma 5.17]) viscosity supersolution 
of ED . 

We can similarly show that u± is a viscosity subsolution of ED- The proof is completed 
by invoking Lemma [2.31 □ 

3 Convergence results for continuous / 

In this section we prove convergence of the schemes (1S2|) and (1S3I) under the assumption that 
/ is continuous and nonnegative. 

3.1 The scheme (S2) 

Let h > 0 and x € (0,1])). Given values for Vh{x — he 1 ), • • • ,Vh(x — he n ), we define Vh(x ) to 
be the largest solution of (1S2|) . If we let a* = v(x — hei) for i = 1 , ,n and b = h n f(x), then 
this is equivalent to finding the largest solution t of 

n 

F(a u ...,a n ,b, t ) := ]J(t - a;) + - bt n ~ l = 0. (3.1) 

i— 1 

We define 

S(a±, ...,a n ,b) = sup jf € M : F(ai, ... ,a n ,b,t) = oj. 

Since t = 0 is always a solution of (13.11) . it is easy to see that S(x) is a nonnegative real number 
for all x € [0,oo) n+1 . With these definitions, the solution Vh of ()S2j) satisfies Vh(x) = 0 for 
x € T and 

Vh(x) = S(v h (x-hei),...,v h (x-he n ),h n f(x)) for all x € (0,1])). (3.2) 

We shall refer to Vh as the maximal solution of (1S2I) . 

We now establish some important properties of S. 

Lemma 3.1. Let x G [0,oo) n+1 . Then 

(i) S(x) > maxjxi,... ,x n } and S(x) = maxjxi,... ,x n } if and only if x n +\ = 0, 

(ii) F(x,t ) > 0 for all t > S(x), 
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(iii) If x n+ 1 > 0 then F(x,t ) < 0 whenever 0 < t < S(x), and 

(iv) S : [0, oo) n —>• [0, oo) is nondecreasing in all variables. 

Proof. By symmetry, we may assume that x\ < X 2 < ■ ■ ■ < x n . 

For (i), we simply note that F(x,x n ) < 0 and lim^oo F(x,t) = oo. Therefore there exists 
t > x n such that F(x,t) = 0. It follows that S(x) > t > x n . If x n +i = 0, then clearly 
S(x) = x n . Conversely, suppose that x n+ \ >0. If x n = 0 then S(x) = x n+ \ > 0 = x n . If 
x n > 0, then F(x,x n ) < 0 and hence S(x) > x n . 

For (ii) If x n +i = 0, then S(x) = x n , and it is clear that F(x,t ) > 0 for all t > S(x). If 
x n . |-i > 0, then by (i), S(x) > x n and F(x,S(x)) = 0. For any t > x n such that F(x,t ) = 0 
we have 

n 

F t {x, t) = ^2 JJ(f - xf) - (n - l)x n +it n ~ 2 
j =1 

n 

= x n+ it n ~ l V - (n- 1 )x n +it n ~ 2 

“ t~Xj 

j=i 

> nx n +it n ~ 2 - (n - l)x n +it n ~ 2 = x n +it n ~ 2 > 0. (3.3) 

It follows that F(x,t) > 0 for all t > S(x). This establishes (ii). 

For (iii), suppose first that x n = 0. Then F(x,t ) = t n — x n+ \and S(x) = x n +\, from 
which (iii) immediately follows. If x n > 0, then since x n +i > 0 we have F(x,t ) < 0 for all 
0 < t < x n . Therefore there exists e > 0 such that F(x,t ) < 0 for 0 < t < x n + £. Define 

t = sup|f € M : F(x,s ) < 0 for all s G (0,t)j. 

Clearly F{x,t ) = 0 and t > x n + e. For any t > r satisfying F(x,t ) = 0, we have by (13.31) 
that Ft(x,t) > 0. It follows that t = S(x), which establishes (iii). 

For (iv) we set 

U = {x € [0, oo) n+1 : max{xi,..., x n } > 0 and x n +i > 0}. 

By (i), S(x) > x n for every x G U. Therefore F t (x,S(x)) > 0 for all x € U, and it follows 
from the implicit function theorem that the restriction of S to U is smooth. 

Since F{x, S(x)) = 0 we have 

n 

^log (S(x) -Xj) = log(x n+ i) + (n- 1) log(5(x)). (3.4) 

3 =1 

Differentiating (13.41) in x% for i € {1,..., n} we obtain 

(y- 1 n- 1 

\j^S(x) — Xj S(x) I Xl S(x) — Xi 

Since S[x) > Xj for all j E {1,..., n}, we have 

n . n . 

_I_> y J— = 

S(x) — Xj j^S(x) S(x) 
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It follows that S Xi (x) > 0. Differentiating (|3.4|) in x n+ \ we have 


E 


n — 1 


—^ S(x) — Xj S(x) 


S. 


^ n -\-1 


0) = 


%n +1 


As before, it follows that 5' 3 , 7l+1 (x) > 0. Therefore S is strictly increasing on U. 

If x n _|_i = 0, then S(x) = maxjsi,... ,x n } is nondecreasing. If x n = 0, then S(x) = x n+ \ 
is again nondecreasing. The continuity of S establishes (iv). □ 

Remark 3.2. In the proof of Lemma 13.11 (iv), we can use the inequality 


E 


> 


+E 


+ 


n — 1 


“ S(x) — Xj S(x) — Xi S{x) S(x) — Xi S(x) 


to find that S Xi (x) < 1 for all x € U and i € {1,..., n}. Since 5(0,..., 0, x n +i) = x n+ \, we 
have the bound 

n+l 

S(x) < x i■ ( 3 - 5 ) 

i— 1 

Using the properties of 5 from Lemma f3. II we can establish a comparison principle for the 
scheme ([S2]l . 

Theorem 3.3. Let h > 0 and suppose f > 0. Let v\ be a subsolution of ([S2]) and let V 2 be a 
supersolution of (IS2j) satisfying 


V 2 (x) > S(v 2 (x — he \),..., V 2 (x — he n ), h n f{x)) for all x G (0, Iff. (3-6) 


Then v\ < V 2 on [0,1]JJ. 

Proof. We will prove the result by induction. We have ui(x) < V 2 (x) for s € T/, by definition. 
Now let x € (0,1]^ and suppose that 

v\(x — hef) < V 2 (x — hef) for i = 1,... ,n. (3-7) 

Since v\ is a subsolution of (IS2I) we have 


F{v i(x - he i), ...,vi(x- he n ),h n f(x),vi(x)) < 0. 

It follows from Lemma o (ii) that 

vi(x) < S(vi(x - he i),... ,vi(x - he n ), h n f(x)). (3.8) 

Recalling (13.611 and Lemma 13.11 (iv) we have 

vi(x) < S(vi(x - he i),.. .,vi(x - he n ),h n f(x)) 

< S(v 2 (x - he i),... ,v 2 (x - he n ),h n f(x)) < v 2 {x). 


The proof is completed by induction. 


□ 
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Remark 3.4. If / is positive and v is a supersolution of (IS2[) that is positive on (0,1]7, then it 
follows from Lemma 13.11 (iii) that 

v(x) > S(v(x — he i),..., v(x — he n ), h n f(x)) for all x € (0, l]j£. (3-9) 

Remark 3.5. Notice that 


v(x) = (x\ ■ ■ ■ x n ) sup / and 

[ 0 , 1 ]" 

are super- and subsolutions of (|S2j) . respectively. 


v(x) = (xi • • • x n ) inf / 

[ 0 , 1 ]" 

By Theorem 13.31 and Remark 13.41 


(xi • • • x n ) inf / < Vh{x) < (xi ■ ■ ■ x n ) sup / for all x € [0,1]£. 

[ 0 , 1 ]" [ 0 , 1 ]" 


(3.10) 


As a consequence, if / = C > 0 then Vh(x) = Cx± ■ ■ ■ x n , which is exactly equal to the maximal 
viscosity solution of (|P2]). 

We can now establish convergence of the scheme (IS2I) . 

Theorem 3.6. Let f S C([0, l] n ) be nonnegative, and for each h > 0 let Vh denote the maximal 
solution of ()S2l) . Then Vh —>• v uniformly on [0, l] n as h —>• 0, where v is the maximal viscosity 
solution of (|P2j) . 


Proof. Let 


v(x) = lirnsup Vh(y) and v(x) = liminf Vh(y)- 
h-> o 

y—>x y—* x 


By Theorem 12.21 and Remark 13.51 v £ USC([0, l] n ) is a viscosity subsolution of (IP2D . By 
Lemma [2.61 v < v. 

Let Uh be the solution of (IS1I) . and let tfh( x ) = Uh(x) n /n n . Since t i —> t n is convex for 
t > 0 and Uh is nondecreasing, we have 


D i ^h(x) 


Uh(x) n - u h {x - hef) 
n n h 


^ n n- 1 D i “'*(*)• 


Therefore 

Df if h (x) ■ ■ ■ D~if h (x) < 'if h (x) n ~ 1 f(x) for all x € (0,1 ]£. 

By Theorem 13.31 ifh < Vh on [0,1]^. As in the proof of Lemma 12.41 we have that 'iph —> v 
uniformly on [0, l] n as h —>• 0. It follows that v>v, which completes the proof. □ 

Remark 3 . 7 . Notice in the proof of Theorem 13.61 we showed that uLf < n n Vh , where Uh is the 
numerical solution of ([Sip, and Vh is the solution of ()S2|) . Under the assumptions of Theorem 
o this gives a one-sided convergence rate for (IS1I) of the form 


u n h -u n < CVh, 


(3.11) 


where u is the nondecreasing viscosity solution of f|Pl[l . When u is concave, we can actually 
prove that Uh <u (see |6| Lemma 3.5]). 
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3.2 The scheme (S3) 

Recall that we defined the solution Wh : [0,1]^ —>• R of (1S3I) inductively by taking Wh(x ) to be 
the largest solution of the polynomial equation defining (1S3I) at each x. It is easy to see that 


Wh(x) + nXiDi w h {x) > 0 for all x € [0, 1]% and i G {1,..., to}. (3-12) 

The following lemma shows that (IS3|> admits a comparison principle whenever the supersolu¬ 
tion satisfies (|3.12|> . 

Lemma 3.8. Suppose f is nonnegative. Let w\ and W 2 be sub- and supersolutions of (|S3l) . 
respectively, and suppose W 2 satisfies (13.1211 . Then w\ < W 2 on [0, 1]^. 

Proof. Let x € [0,1]? be a maximum of w± — W 2 , and suppose to the contrary that wi(x) > 
W 2 (x). Then we have 

D~wi(x) > Dfiuj 2 {x) for all i such that x;* 0. 

Recalling (|3.12p we have 

n n 

/(*) < n<«*<* ) + nx i D i w 2 (x)) < ) + nx i D i wi(x)) < f(x), 

2—1 2—1 

which is a contradiction. □ 


We now prove convergence of (1S3|1 . 

Theorem 3.9. Let f € C([0, l] n ) be nonnegative, and for h > 0 let Wh be the maximal 
solution of (1S3I) . Then Wh —>• w uniformly on (0, l] n as h —>• 0 ; where w is the maximal 
bounded viscosity solution of (1P3I) . 


Proof. Let 


w(x) = lim sup Wh (y) 

h^O 
y-> x 


and 


w(x) = lim inf Wh{y). 
0 

y^x 


We can use the comparison principle from Lemma [3.81 to show that 


inf fn < Wh < sup / n . 

[ 0 , 1 ]- [ 0 ,!]" 


Therefore 


inf / - < w< w < sup / -. 

[ 0 , 1 ]" [ 0 , 1 ]" 


By Theorem 12.21 w € USC((0, l] n ) is a bounded viscosity subsolution of (IP3I) and w G 
LSC((0, l] n ) is a bounded viscosity supersolution of (jP3|) . Furthermore, since Wh satisfies 
(13.121) another application of Theorem !2.2l shows that in is a viscosity solution of (12.611 for all i. 
By Theorem 12.71 w = w = w, where w is the maximal bounded viscosity solution of (1P3|) . □ 
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4 Rates of convergence for positive and Lipschitz / 

In order to obtain a rate of convergence, it is necessary to show that the either the numerical 
solution or the viscosity solution of the continuum equation is Lipschitz continuous up to 
the boundary T. Since none of the Hamiltonians considered in this paper are coercive, the 
standard textbook estimates [T] do not apply. 

4.1 A Lipschitz estimate in dimension n = 2 

In dimension n = 2, we can prove the required Lipschitz estimate for v directly by differen¬ 
tiating (IP2j) and using a comparison principle. Let us briefly sketch the argument, which is 
made rigorous at the level of the numerical scheme (1S2I) in Theorem 14.21 
Formally differentiating (IP2I) in the variable x\ we have 

^xixi^X2 ^X\^X\X2 vfx 1 + f Vx 1* 

Setting ^ = v Xl and noting that v(x) < sup^ip / we have 

Vhii V X 2 + H’xi - f)^ < [/] 1:[0,1] 2 SU P /• (4-1) 

[0,1] 2 

Consider using a comparison function of the form 'if(x) = C( 1 + a^)- Since fj Xl = 0, the first 
term in (14.11) can be ignored. Furthermore, for C > sup-Q n 2 /, the sign of the zeroth order 
term in (14.11) is positive, which suggests that a comparison principle should hold, allowing us 
to show that v xi = < C(l + X 2 ) for a possibly larger constant C > 0. 

Of course, v is not in general smooth enough to use this argument directly, so we need to 
regularize (IP2I) . One obvious approach would be the method of vanishing viscosity. However, 
there are some technical challenges with this approach, due to the sign of the zeroth order term 
in (IP2I) and the (non-obvious) fact that for positive viscosity, v £ can fail to be nondecreasing. 
Our approach is to apply the argument above at the level of the numerical scheme (IS2I) . Since 
we showed convergence of (1S2I) in Theorem 13.61 a Lipschitz estimate on Vh directly carries over 
to the maximal viscosity solution v of (1P2I) . 

Heading in this direction, we now recall some basic properties of finite differences. 

Proposition 4.1. For all k,j € {1,... ,n} we have 

(i) D t D t u = D t D k u and D k D j u = D j D t u > 

(ii) D±(uv)(x) = u(x)D^v(x) + v{x ± he k )D^u(x), 

(hi) D k {uv) = uD^v + vD±u ± hD±uD±v, 

We now give a preliminary regularity result for Vh. 

Theorem 4.2. Let n = 2, let f £ C'°’ 1 ([0, l] 2 ) be nonnegative, and let v k be any nondecreasing 
solution of (1S2I) . Then for k = 1,2 we have 

0 < D~v h {x) < [/] x ;[01 ]2 + 3 sup / for all x € (0, l] 2 h . (4.2) 

[o,i ] 2 
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Proof. Let us prove the result for k = 1; the case of k = 2 follows by symmetry. We extend Vh 
to a function on [—h, 1 ]f by setting Vh(x) = 0 for x G [—h, 1]| \ [0,1]|. With these definitions, 
we have Vh(x) = D~Vh(x ) = 0 for x G T^. Since Vh is nondecreasing, we therefore have 

Dfv h (x)Dfv h (x) = v h (x)f(x) for all x G [0,1 ]|. 

We now apply the operator Df to the equation above and use Proposition 14.11 (ii) to obtain 

Df v h (x)Df Df Vh(x) + Df Dfv h (x)Dfv h (x - he i) = v h (x)Df f(x) + f(x - hei)Dfv h (x) 

for all x G (0,l] 2 . Setting ip(x) = Dfvh(x) and using Proposition 14.11 (i) we have 

ip{x)Df ip(x) + Df v h (x - hei)Df ip{x) = v h (x)Df f(x) + f(x - hei)'ip(x). 

Applying Theorem 13.31 and Remark 13.51 

Dfv h (x - hei)Dfi/j(x) + (Dfif(x) - f(x- hei))t/j(x) < [/]i ;[0 ,i ]2 sup f =: M (4.3) 

[ 04] 2 

for all x G (0,1]^, and ip(x) = 0 for x G We can assume M > 0, otherwise Vh(x) = cx 1 X 2 
and 1)4.2 ji is trivial. 

Let ip(x) = (VM + sup[g 1 ]2 (1 + X 2 ) and note that since Vh is nondecreasing we have 

Dfvh{x — hei)Dfip(x) + (Dfip^x) — f(x — hei))ip(x) > M + \[M sup /. (4.4) 

[0,1] 2 

We claim that if < ip. Assume by way of contradiction that maxj 0 ^2 (ip — ip) > 0. Since 
ip = 0 < ip on Th, tp — Tp must attain its positive maximum at some x G (0,1]|. It follows that 
Dfip(x) > D~ip(x) for i = 1,2 and ip{x) > ip(x). Since Df'ip(x) — f(x — hep) > 0 and Vh is 
nondecreasing, we can combine (14.31) and (14.41) to find that 

M + yfM sup / < M, 

[0)1] 2 

which is a contradiction to the positivity of M. By Cauchy’s inequality 



for all x G (0,1]|. □ 

Since Vh —>• v uniformly (Theorem 13.61) . we can extend the Lipschitz estimate in Theorem 
IQ to (lP2l) . 

Corollary 4.3. Let n = 2, let f G C' o,1 ([0, l] 2 ) he nonnegative, and let v be the maximal 
viscosity solution of (IP2D . Then there exists C > 0 such that 

Hl;[0,l] 2 < C'I|/||C'°. 1 ([0,1]™)- ( 4 - 5 ) 

The proof of Theorem 14.21 does not work in dimensions n > 3 due to the additional non¬ 
linearity of (IP2D . which increases with n. In Section T3.21 we study the auxiliary problem (IS3D . 
which allows us to prove Lipschitz regularity of the maximal viscosity solution of (1P2I) in arbi¬ 
trary dimension (see Lemma 14.101) . provided the strictly stronger condition /« g C 0,1 ([0, l] n ) 
holds. We expect Theorem 14.21 to hold in dimensions n > 3 under the natural condition 
/ G C ,o,1 ([0, l] n ), but we currently do not know how to prove this. 
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4.2 The scheme (S3) 

In this section we prove Lipschitz regularity and rates of convergence for the scheme (1S3|) . 
This establishes one of our main results (Theorem 11.21) . These results are used in Section 11.31 
to prove similar rates of convergence for (IS2I) . 

Throughout this section we set 

n 

H(x,z,p ) = + nxi.pi) + , 

1=1 


for (x, z,p ) € M n x R x M n . 

4.2.1 Lipschitz regularity 

Let us first give a formal argument suggesting a Lipschitz estimate on the maximal bounded 
viscosity solution w of (IP3I) . Assuming w is smooth and / > 0, we can take the logarithm of 
(IP3D to obtain 

n 

^2 log(w + nxjW Xj ) = log(/) 

3 =1 

Differentiating both sides in the variable Xi and setting ip = w Xi we have 

(1 + T nXj(p Xj _ f x . 

“ w + nxjW Xj f 

where 5,^ = 1 if i = j and 6ij = 0 if i ^ j. Notice that at a positive maximum of ip we have 
<p x . = 0 for all j and hence 


nf rup = nipY\( w + nxjW Xj )~ 
i= 1 




(i + 

^w + nxjW Xj 


fxj 

f 


where we employed the inequality of arithmetic and geometric means in the first inequality. 
This suggests that 



In Theorem 14.61 and Lemma 14.81 we make this argument rigorous by applying it to the 
numerical scheme (|S3|) . One obvious gap in the argument above is the existence of a positive 
maximum for w Xi . Indeed, when w is any of the infinitely many unbounded viscosity solutions 
of (1P3[) . w Xi either has no maximum value, or no minimum value, on (0, l] n . This is a 
reflection of the fact that (1S3I) has no boundary condition. This issue is resolved by showing 
(in Proposition 33]) that the numerical solution Wh can be extended by projection to a solution 
of (IS3l) on the domain (—oo, 1]JJ. 

For x € M™, let us set 

X+ = ((xi)+,...,(x n ) + ). 
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Proposition 4.4. Suppose f is nonnegative, and let w be a sub- (resp. super-) solution of 
(1S3[) . Then w(x) : = w(x+) is a sub- (resp. super-) solution of 

H(x+, w(x), D~w(x)) = f(x) for all x € (— 00 ,1]^, (4-7) 

where f(x) := /(x+). 

Proof. We claim that 


(xi)+D i w(x) = (xi)+D i w{x + ) for all x € (- 00 ,1]£, i G {1,..., n}. 

If Xi < 0 the result is trivial. Hence we may assume that Xi > h, so that (x — hei)+ = x+ — h&i 
Then 

D- Mx) = «-(x+) - w«x - heO + ) = <a(x + ) - Wx + - he,) = D -„, (x+)i 

which establishes the claim. 

For x € (— 00 , Iff \ [0, Iff, we have x + G [0,1]JJ and 


I (“>(®) + n{x i ) + D i w(x)) + = JJ (u>(x+) + n(x i ) + D i w(x+)) + . 


2=1 


2=1 


Since f(x) = /(x+), the result immediately follows. □ 

We also note that we can extend the product rule for finite differences in Proposition 14.11 
(iii) by induction as follows: 

Lemma 4.5. For all k € {1, ... ,n} and N > 2 we have 

N N 

d £( ui --- u n ) = E^rh+£( ± ^" 1 n^IK ( 4 - 8 ) 

j=1 i^j 3 = 2 |/|=J 

where the final summation is over all I C {1,... ,N} with |/| = j. 

The proof of Lemma 14.51 is deferred to the appendix. We now establish a Lipschitz estimate 
on the solution Wh of (jS2|) . 

Theorem 4.6. Suppose that f G C' 0,1 ([0, l] n ) is positive on [0, l] n , and let Wh be the maximal 
solution of (1S3I) . Then 

inf -f(x + he k )n~ 1 (D(( /(x))_ < D%w h {x) < sup -f^~ 1 (D(ff)+. (4.9) 

xeu k n u k n 

for all x € Uk ■= {x € [0,: x k < 1 — h}. In particular 

sup \D^Wh\ < —[/]i;[o,i]« sup fn- 1 . (4.10) 

Uk n [0,1]™ 
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Proof. For notational convenience, we will write w in place of Wh throughout the proof. 

By Proposition (14.71) . we can extend w and / to functions on (— 00 , Iff by setting w(x) = 
w(x. |_) and f(x) = f(x+), and we have 

H(x+, w(x), D~~w{x)) = f(x) for all x G (— 00 , Vff. (4-11) 

Let tp(x) = Dffw{x) for all x G (— 00 , Iff with Xk < 1 — h. 

The proof is split into two steps. 

1. We first show that 

sup Dffw < sup /)+. (4.12) 

U k u k n 

We may assume ip is positive somewhere, otherwise (14.121) trivially holds. For any x such that 
%k < ~h, we have = (x + hek)+- This implies that <p(x) = 0. Likewise, whenever Xk > 0, 
(x + hek)+ = + hek and we have <p{x) = ip{x+). It follows that 92 attains its positive 

maximum value at some xq £ Uk- Therefore 


<p(xo) > 0 and D- <p(xq) > 0 for all j G {1,..., n}. 


Since f(x) > 0, 

where 

By Lemma [4.51 


fix) = H(x+, w(x), D w(x)) = JJ aj{x), 

3= 1 

a,j(x) = w{x) + n{xj) + D~w{x) > 0. 


n i\ 

D ifi x ) = ^2 D t a ji x )]l a ii x )+'52 h3 ' 

3 = 1 *¥=3 3 =2 


1 . II D tai{x) 11 , 

I I\=jiei m 


Using Proposition 14. II (ii) we have 


(4.13) 


(4.14) 


(4.15) 


Dffaj{x) = Dffw{x) + n5j )k D- w(x + he k ) + nxjDfDj w(x), 

for x G [0,1])). Invoking Proposition 14.11 (i) and noting that Dfw(x + hek) = Dfw(x), we 
deduce 

Dfcij(x) = (1 + n5j t k)p(x) + nxjDj(p(x). (4-16) 

Inserting (14.131) into (14.16ji yields D~jfcij{x 0 ) > <p(xq) > 0 for all j. Combining this with (14.15|) 
and recalling that a,i(xo) > 0 gives 

n N 

D tfi x u) = Y; D t a ji x 0 ) a i( x 0 ) + ll n D+ai(x 0 )Y[ai(x 0 ) 

3 =1 3=2 \I\=j iel i&I 

n 

> pi x o) ^2 n °t( x o)- (4-17) 

i =1 i¥=j 
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Using the inequality of geometric and arithmetic means yields 


7 i # H 

En cn(x 0 ) > n nn ®i(®o) 


= n 




= nf(x 0 y 


(4.18) 


1 =1 


V =1 * 7 U 


1 


Combining (|4.17|> and (14.181) establishes (14.121) . 
2. We now show that 


inf Dtw > inf -f{x + he k )* 1 (Dtf{x))-. 


u k 


xeu k n 


(4.19) 


We may assume that ip assumes negative values, otherwise (14.191) is trivial. As in the first part 
of the proof, ip attains its negative minimum at some xq E U k . Therefore 


p(x o) < 0 and D ■ p(x o) <0 for all j E {1,..., n}. 

By ()4.16p . Dtdj(x o) < (p(x o) < 0 for all j. Combining this with Lemma [4.51 yields 


(4.20) 


N 


D tf ( x ) = '^ J D t a j{x)W a i{.x + he k ) -^h 3 1 ^2 ai{x))Y\_a,i{x + he k ) 

j=1 i^j i= 2 \I\=j i&I 


< v(xo) En a,i(x 0 + he k ) 
1=1 * 7 U' 


< rup(x 0 ) nn ai(x 0 + he k ) J = nf(x 0 + he k ) « <p{x Q ). 

y =1 


This completes the proof. 


□ 


Remark 4.7. Since w k —> w uniformly on [0, l] n , it is an easy consequence of Theorem 14.61 that 
w E C^QO, l] n ) and 

"| 1 — 

Hl;[0,l]“ < —7=[/]l;[0,l]" SU P /~» ( 4 ‘ 21 ) 

V n [0,1]™ 

whenever / E C' 0 , 1 ([0, l] n ) is positive. A sharper result is contained in the following lemma. 

Lemma 4.8. Let f be a nonnegative function for which fn E C'°’ 1 ([0, l] n ), and let w be the 
maximal bounded viscosity solution of (IP3I) . Then w E C' 0 , 1 ([0, l] n ) and 


Mi;[o,i] n E Vn[f n ] 1;[0,1L 


(4.22) 


Proof. We first assume that / E C 2 ([0, l] fl ) and / > 0. For h > 0, let Wh be the maximal 
solution of ()S3j) . Since / E C 2 ([0, l] n ), there exists a constant C > 0 such that 


Dffix) < f Xi (x) + Ch, 
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for all i and all x € Ui := {x € [0,1])J : x* < 1 — h}. By Theorem 0? 


Df w h(x) < SUp ~f(x)n 1 (£>+/(£)) + 
x&Ui n 

< sup (-f(x)n~ 1 f x .(x)+ Ch 

xeUi \ n 


= SUp((fn) x . + C7l) + 

— [/™]l;[0,l] n + Ch. 

The opposite inequality is obtained similarly, and we find that 

\Dfw h {x)\ < [/^]i ; [ 0 ,i]n + Ch , 

for all i and all x € Ui. The estimate (|4.22l) follows from the uniform convergence Wh —>• w as 

0 . 

We now suppose that / is nonnegative and /« € C 0 , 1 ([0, l] n ). Extend / to a function 
on by setting /(x) = /(7r(x)) for x 0 [0, l] n , where 7 r : —> [0, l] n is the closest point 

projection. Since n is 1-Lipschitz, [/™] i,m« = [/"]i,[o,il n - Let rf denote the standard modifier, 
and define 

/ i \ n 

f = (rf * P- + ej • 

It is easy to verify that f e € C' oo ([0, l] n ), f £ —>• / uniformly on [0, l] n as e —>• 0, and 

[(/ £ ) ™ ]l;[0,l] n < [/ n ]l;[0,l] n ■ (4.23) 

Let w £ denote the maximal bounded viscosity solution of (IP3I) corresponding to f £ . Since f £ 
is smooth and positive, the argument above yields 

i 6H9 i 

[^ £ ]l;[0,l] n — V^[(/ £ ) "']l;[0,l] n < V^[/ n ]l;[0,l] n - 


By the comparison principle for (1P3D (Theorem 12.71) and standard results on viscosity solu¬ 
tions [7], we have w £ — >• w uniformly on [0, l\ n as e — >• 0. Therefore 

Hl;[0,l] n — Vn\f n ] 1;[0,1]”; 


which completes the proof. 


□ 


Remark 4.9. The regularity result in Lemma 14.81 is tight, and cannot be significantly gener¬ 
alized. For intance, if f(x) = 2xi, then / is smooth, but /(x)™ = (2xi)™ is not Lipschitz 

on [0, l] n . The corresponding solution of (IP3I) is w{x) = xf, which also fails to be Lipschitz 
on [0, l] n . Note that the solution of (IP2I) is v(x) = (xi • • • x n )w(x) n = x\x 2 • • • x n , which is 
smooth on [0, l] n . 

We can now extend Lipschitz regularity to viscosity solutions of (IP2I) . 

Lemma 4.10. Suppose f is a nonnegative function for which fn g C' 0,1 ([0, l] n ), and let v be 
the maximal viscosity solution of (IP2p . Then v € C' o,1 ([0, l]" - ) and 

Tl — 1 1 

Ml;[0,l] n — L*||/ " llL oo ([0,l] n ) II / 71 110 0 ’ 1 ([0,1] "•) ■ (4.24) 
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Proof. Notice that we can write 

v(x) = X\ ■ ■ ■ x n w(x) n , x G [0, l] n , 

where w is the maximal bounded viscosity solution of (1P3I) . Therefore 

Hl;[0,l]« < [^ n ]l;[0,l]- + [®1 • - - ^7T.]l;[0,l]« SUp /. 

[ 0 , 1 ]" 

The estimate (|4.24p follows from Lemma 14.81 and the inequality 

[u> n ]l;[o,i]" < n|kll^ 1 ([ 0 ,l]n)Ml;[ 0 1 l]"- D 

We expect Lemma [4.101 to hold under the weaker condition that / G C'°’ 1 ([0, l] n ), but we 
do not currently know how to prove this. 

4.2.2 Convergence rate 

Since we know the scheme (1S3|) converges, we can prove a result analogous to Proposition 14.41 
regarding extensions of viscosity solutions of (1P3I) . 

Proposition 4.11. Suppose f G C([0, l] n ) is nonnegative and let w be the maximal bounded 
viscosity solution of (1P3D . Thenw(x ) = w(x+) is a viscosity solution of 

H(x + ,w,Dw) = f on {— oo,l] n , (4.25) 

where f(x) = f{x + ). 

Proof. Let Wh ■ [0, l]^ —> M+ denote the solution of (1531) for h > 0. By Theorem 13.91 Wh —>• w 
uniformly on [0,1] ? \ Set Wh(x) = Wh(x + ) for x G (—oo, Iff. By Proposition 14.41 Wh is a 
solution of the discrete scheme 

H(x + , Wh(x), D~~Wh(x)) = f(x) for all x G (—oo, 1])(. 

Since Wh —>• W uniformly on (—oo, l] n , Theorem 12.21 shows that W is a viscosity solution of 

□ 

Before proving a convergence rate for (1S3I) . we need another preliminary proposition. 
Proposition 4.12. For (xo,zo,Po) G M n x R x M n such that H(xq, zo,po) > 0 

9H n — 1 

-Q^(x 0 ,z 0 ,p 0 ) > nH(x 0 ,z 0 ,Po) :L ^ r - (4.26) 

Proof. Since H(xq, zo,po) > 0 we can write 

n 

H(x, z,p) = J|(z + nXiPi ), 

2=1 


23 








in a sufficiently small neighborhood of (xq, Zq,Pq). In this neighborhood 


d . 1 

—H(x, z,p) = H{x,z,p) 2_^ 


i —1 


z + nXiPi 


> nH(x,z,p) ( TT ——^- 

\f = l Z + nX iPi / 
/ \ n ~ 1 
= nH(x,z,p) n , 


i_ 

n 


where we used the inequality of arithmetic and geometric means. □ 

We now give the proof of Theorem 11.21 

Proof. We extend / to a function on (—oo, 1]” by setting f(x) = f(x+). By Proposition 14.41 
we can extend Wh to a function on (—oo, 1]7 satisfying 

H(x + ,w h (x),D~w h (x)) = f(x) for all x € (-oo, 1]^, 

by setting Wh(x ) = Wh(x+). Similarly, by Proposition 14.Ill we can extend w to a function on 
(— 00 , 1 ]"" by setting w(x) = w(x+), and w is a viscosity solution of 

H(x+,w,Dw) = f in (—00,1]"". 

We will show that 

Wh — w < CVh. (4.27) 

The opposite inequality is proved similarly. We can assume that sup[ 0 i i]»(u^ — w) > 0. For 
a > 0 , x € (—oo, 1 ]JJ and y € (—oo, 1 ]”, set 

$(z, y) = W h (x) - w(y) - ^\x - y | 2 . 

Since Wh(x) = Wh(x+), w(y) = w(y+) and |x+ — y+| < \x — y |, there exists x a € [0, Iff and 
y a € [ 0 , l] n such that 

&(x a ,y a ) = max <L. (4.28) 

(-00,1]" x (-00,1]" 

Let <p(x) = 7j\x — y a \. Then Wh ~ P attains its maximum at x a with respect to the grid 
(—oo, 1]JJ. Therefore D~Wh(x a ) > D~ip(x Q ) for all i. Since x a G [0,1]JJ and H is directed, 

H(x a ,w h (x a ),D~(p(x a )) < H(x a ,w h (x a ),D~w h (x a )) = f{x a ). (4.29) 

Since <L(x a ,a; Q ) < $>(x a ,y a ), we see that 

x a - y a | 2 < w(x a ) - w(y a ) < C\x a - y a |, (4.30) 

where we invoked Remark IQ in the last inequality. Since 

D~tp(x a ) = a(x a - y a ) - ^ 1 , 
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we have 


|D tp(x a ) — p a \ < Cah, 

where p a = a(x a — y a ). By (14.301) . \p a \ < C. Therefore, we can invoke the local Lipschitzness 
of H in all variables to obtain 


| H(x a ,w h (x a ),D ip{x a )) - H(y a ,w h (x a ),p a )\ < C (ah + \ 
Combining this with (14.291) yields 


V a 


H{y a ,w h (x a ),p a ) < f(y a ) + C ( ah + - ) . 


By (14.281) we also have 


H{y a ,w{y a ),Pa) > f{y a )• 


Subtracting these equations yields 


H(y a ,w h (x a ),p a ) - H(y a ,w(y a ),p a ) < C 



Since 


w h {x a ) - w(y a ) > $(x Q ,y a ) > sup (w h -w)>0, 


we have Wh(x a ) > w{y a ). Since f(y a ) > 0, we can invoke Proposition 14. 12l to find that 


rc/(ya) n " {wh{x a ) - w(y a )) < H(y a ,w h (x a ),p a ) - H(y a , w(y a ),p a ) < C ah + - 


a 


Choosing a = -^= we have 


sup (wh — w) < Wh{x a ) — w(y a ) < CVh. □ 

4.3 The scheme (S2) 

We now prove a convergence rate for (1S2|) . This follows directly from Theorem 11.21 and the 
following result. 

Lemma 4.13. Suppose f G C 0,1 ([0, l] n ) is positive. Let Wh be the solution of (jS3l) . and let 
Vh be the maximal solution of (1S2I) . Then 

|xi • • • x n w h (x) n - v h (x)\ < Ch for all x G [0,1]^, (4.31) 

where 

C = c(n, [/] h[o,!]"’“[„/)■ 
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Proof. Set v(x) = X\ ■ ■ ■ x n Wh(x) n for x G [0,1]^. By Lemma [4.51 Remark 14.71 and the 
inequality Wh > inf /« > 0, we have 

D~v(x) = — Xn w h (x) n ~ 1 (w h (x) + nxiD~w h (x) + 0(h)) . 

X{ 

Here, we use the notation 0(h) to denote function of x that is bounded uniformly by Ch with 

C = C(n, [f ] mi] n, inf jy 

Since Wh satisfies (1S3I) we have 

n 

II {wh(x) + nx t D~w h (x) + 0(h)) + = f(x) + 0(h). 

1=1 

It follows that 

(Df v(x)) + • • • (D~v(x))+ = v(x ) n_1 (f(x) + 0(h )). 

Therefore, there exists a constant C such that 

(Dfv(x)) + • • • (D~v(x))+ < v(x ) n ~ 1 (f(x) + Ch ). 

Let a = Ch/ inf / and set = (1 + a)vh- Then 

(Dfv h (x)) + ■ ■ ■ (D~v h (x)) + = v h (x) n ~ l (l + a)f(x) > v h (x) n ~ l (f(x) + Ch). 

Since Vh > 0 and / > 0, we can use Theorem 13.31 and Remark 13.41 to conclude that v < Vh < 
v h + Ch on [0,1]£. 

Likewise, there exists a constant C such that 

(Dfv(x)) + ■ ■ ■ (D~v n (x)) + > v(x ) n ~ 1 (f(x) - Ch). 

Let a = Ch/ inf /, and take h > 0 small enough so that a < 1. Define v h = (1 — a ) v h- Then 
(Dfv h (x))+ ■ • • (D~v h (x))+ = L/ l ( x ) n_1 (l - a)f(x) < v h (x) n ~ 1 (f(x) - Ch). 

Since v > 0 on (0,1]JJ we have v > v h > Vh — Ch on [0,1]^. □ 

We now have the proof of Theorem 11.11 

Proof. Let Wh be the solution of (1S3[1 and let w be the maximal bounded viscosity solution of 
(IP3D . By Theorem 11.21 

| Wh(x) — w(a;)| < CVh for all x G [0,1]^. 

By Lemma [4.131 we have 

\vh(x) — u(x)| < Ch + x\ ■ ■ ■ x n \wh(x) n — w(x ) n | < CVh, 

for all x G [0,1]^ and h > 0 sufficiently small. The inequality (11.51) follows from the lower 
bounds 

Vh(x),v(x) > 5 n inf / for all x G [(5, 111!. □ 

[ 0 , 1 ]™ 
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5 Numerical experiments 

In this section, we discuss the bisection search method for solving (jSlj) (1S3|) . and we show the 
results of numerical simulations comparing the three schemes. 

5.1 The bisection search 

In dimension n = 2, all three schemes have a closed form solution (see m, (HI, and (HID), 
and can therefore be efficiently solved up to machine precision. In dimensions n > 3, it is 
necessary to use an iterative method to approximate the solution of the scheme. Due to the 
monotonicity properties of all three schemes, it is natural and efficient to use the bisection 
method, or slight variations thereof. The bisection method requires an initial interval to start 
the search, and a specified tolerance for terminating the bisections. The main idea is to set the 
tolerance to match the truncation error of each scheme, so that the error from the bisection 
method is no greater than the error incurred by using finite differences. We describe the details 
for each scheme below. 

For the scheme (SI), we use the bisection search method at each x € (0,1])) to construct 
an approximation Uh of the solution Uh of (ISip . For the initial interval, we use 

h = [ma x{u h (x - he i),... ,u h (x - he n )}, max{u h (x - he i),... ,u h (x - he n )} + hf(x)*], 

and with a slight modification of the bisection method, we can ensure that the solution Uh 
satisfies 

f{x) < u h (x) ■ ■ ■ D~u h (x) < (i + h)f(x) for all x G (0,1]£, (5.1) 

and Uh(x) = 0 for x € By comparison for (IS1D we have 

u h (x ) < u h (x ) < (1 + h)™u h (x) < u h (x) + (aq • • • x n )« (sup f^)h for all x € (0,1]£, (5.2) 

where Uh is the exact solution of (IS1I) . Since this error is no worse than the truncation error 
from using first order finite differences, it is unnecessary to continue the bisection search once 
m is satisfied. 

For the scheme (S2), we use the same bisection search technique to find Vh satisfying 

Vh{x) n ~ l f (x) < D^v h (x) ■ ■ ■ D~v h (x) = v h (x) n ~ 1 ( 1 + h)f{x) for all x <E (0,1]£, 

with Vh{x) = 0 for x € T/j. By Remark 13.21 we may take the initial interval to be 

I 2 = [max{v h (x - hei),... ,v h (x - he n )},v h (x - he i) H- \-v h (x - he n ) + h n f(x)]. 

Letting v h denote the exact solution of (1S3|) we have by Theorem 13.31 and Remark 13.51 that 

Vh{x) < v h (x) < (1 + h)v h (x) < v h (x) + (xi ■■■x n ) (sup/) h. (5.3) 

As before, this error is smaller than the truncation error introduced by discretizing (1P2I) . which 
justifies our choice of stopping condition for the bisection search. 

Finally, for the scheme (1S3|1 . we use the bisection method to obtain Wh satisfying 

n 

f (x) < JJ(^(a;) + nxi.D~ w h {x)) < (1 + h)f{x) for all x € [0,1]JJ. 

2—1 
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(a) u\ (b) u 2 (c) u 3 


Figure 2: Depiction of the level sets of the viscosity solutions of m in dimension n = 2 for 
each of the three test cases. 


We take the initial interval for the search to be 


h = 


a,a + hf(x) n JJ(nx; + h)~ 


1=1 


where 


a = max 


f nx\Wh{x — he\) nx n Wh(x — he n ) 


\ nx i + h 


nx n + h 


By Lemma [3.81 we have 


Wh{x) < w h (x) < (1 + h)*w h (x) < w h (x) + i (swpfn ) h, 


where Wh is the exact solution of 


(5.4) 


5.2 Simulations 

We show here the results of some numerical simulations comparing the three schemes (1S1|> . 
and (1S3I). We first consider 


/i(*) = 


The solution of (IP 1 h is given by 


1, if maxjxi,... ,x n } > 0.5 
0, otherwise. 


ui(x) = n max 

ie{l,...,n} 


Xi - 



The level sets of u\ are illustrated in Figure 2(a) Tables |TJ [2] and [3] show the £°° errors 


and orders of convergence for f\ in dimensions n = 2, n = 3, and n = 4, respectively. For 
each scheme, the £°° errors are measured by how well the schemes approximate the viscosity 
solution u\ of (IPljl . 

This is an interesting test case because is discontinuous, so Theorems 11.11 and II.21 do not 
apply. We see that (1S1I) and (IS3I) have experimental convergence rates on the order of 0(/i"). 
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(SI) 

(S2) 

(S3) 

Mesh size h 

goo £ rror 

Order 

i°° Error 

Order 

goo Error 

Order 

2.5 x 10" 2 

7.1 x 10~ 2 


2.1 x 10~ 2 


6.7 x 10~ 2 


6.3 x 10 -3 

3.4 x 10 -2 

0.54 

5.7 x 10 -3 

0.93 

3.3 x 10" 2 

0.51 

1.6 x 10" 3 

1.6 x 10" 2 

0.51 

1.5 x 10" 3 

0.97 

1.6 x 10" 2 

0.50 

3.9 x 10 -4 

8.2 x 10" 3 

0.50 

3.8 x 10~ 4 

0.98 

8.2 x 10' 3 

0.50 

9.8 x 10" 5 

4.1 x 10" 3 

0.50 

9.7 x 10' 5 

0.99 

4.1 x 10~ 3 

0.50 

2.4 x 10" 5 

2.0 x 10" 3 

0.50 

2.4 x 10" 5 

1.00 

2.0 x 10" 3 

0.50 


Table 1: Rates of convergence for f\ in dimension n = 2. 



(SI) 

(S2) 

(S3) 

Mesh size h 

goo E 1TO r 

Order 

goo E rror 

Order 

goo E rror 

Order 

5 x 10~ 2 

3.1 x 10" 1 


9.1 x 10" 2 


2.1 x 10 _1 


2.5 x 10" 2 

2.3 x 10" 1 

0.41 

5.3 x 10 -2 

0.79 

1.7 x 10” 1 

0.34 

1.3 x 10" 2 

1.8 x 10" 1 

0.38 

3.0 x 10' 2 

0.80 

1.3 x 10” 1 

0.34 

6.3 x 10" 3 

1.4 x 10" 1 

0.36 

1.7 x 10' 2 

0.82 

1.1 x 10” 1 

0.33 

3.1 x 10 -3 

1.1 x 10 _1 

0.35 

9.5 x 10 -3 

0.84 

8.5 x 10 -2 

0.33 

1.6 x 10" 3 

8.5 x 10" 2 

0.34 

5.3 x 10" 3 

0.85 

6.7 x 10" 2 

0.33 


Table 2: Rates of convergence for f\ in dimension n = 3. 



(SI) 

(S2) 

(S3) 

Mesh size h 

goo E rror 

Order 

i°° Error 

Order 

goo E rror 

Order 

2.5 x 10" 1 

1.1 x 10" u 


3.8 x 10" 1 


4.9 x 10 _1 


1.3 x 10" 1 

7.9 x 10" 1 

0.46 

2.4 x 10" 1 

0.68 

4.1 x 10' 1 

0.26 

6.3 x 10 -2 

6.0 x 10" 1 

0.40 

1.5 x 10' 1 

0.64 

3.5 x 10' 1 

0.25 

3.1 x 10" 2 

4.7 x 10" 1 

0.36 

9.5 x 10~ 2 

0.70 

2.9 x 10~ 4 

0.25 

1.6 x 10" 2 

3.7 x 10" 1 

0.32 

5.7 x 10" 2 

0.72 

2.5 x 10” 1 

0.25 

7.8 x 10" 3 

3.1 x 10" 1 

0.29 

3.4 x 10" 2 

0.75 

2.1 x 10” 1 

0.25 


Table 3: Rates of convergence for f\ in dimension n = 4. 


This should be expected, as u\ and w± := u\/n(xi ■ ■ ■ x n )™ are at most Holder continuous 
with exponent and have similar gradient singularities where u\ transitions from zero to a 
positive value. On the other hand, v\ := u±/n n is Lipschitz continuous on [0, l] n , and we 
correspondingly observe a better convergence rate from flS2j) . This illustrates the important 
fact that the transformation v = u n /n n regularizes gradient singularities anywhere in the 
domain [0, l] n , and therefore we expect (IS2I) to have the best convergence rate in general. It is 
interesting to note that (IS2I) attains its formal convergence rate of 0{h ) in dimension n = 2, 
but appears to have a strictly worse rate in higher dimensions. 

The second case we consider is 

sin (kxj) 2 + nk + nkxi sin(2fcxj) , 


h( x ) = 



n n {k + 1) 
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(SI) 

(S2) 

(S3) 

Mesh size h 

goo £ rror 

Order 

i°° Error 

Order 

goo Error 

Order 

2.5 x 10" 2 

9.5 x 10~ 2 


2.4 x 10^ 2 


2.4 x 10~ 2 


6.3 x 10 -3 

4.6 x 10 -2 

0.53 

6.1 x 10 -3 

0.99 

5.9 x 10 -3 

1.01 

1.6 x 10" 3 

2.3 x 10" 2 

0.50 

1.6 x 10" 3 

0.97 

1.4 x 10" 3 

1.02 

3.9 x 10 -4 

1.1 x 10" 2 

0.50 

4.1 x 10' 4 

0.98 

3.5 x 10~ 4 

1.02 

9.8 x 10" 5 

5.6 x 10" 3 

0.50 

1.0 x 10" 4 

0.99 

8.8 x 10' 5 

1.00 

2.4 x 10" 5 

2.8 x 10" 3 

0.50 

2.6 x 10" 5 

1.00 

2.2 x 10" 5 

0.99 


Table 4: Rates of convergence for f 2 in dimension n = 2. 



(SI) 

(S2) 

(S3) 

Mesh size h 

goo E rror 

Order 

g°o Error 

Order 

goo E rror 

Order 

5 x 10~ 2 

3.6 x 10" 1 


6.6 x 10" 2 


5.6 x 10" 2 


2.5 x 10" 2 

2.8 x 10" 1 

0.39 

4.8 x 10" 2 

0.46 

4.0 x 10" 2 

0.48 

1.3 x 10" 2 

2.2 x 10" 1 

0.36 

2.4 x 10~ 2 

1.02 

2.0 x 10' 2 

1.01 

6.3 x 10" 3 

1.7 x 10" 1 

0.35 

1.2 x 10~ 2 

0.94 

1.0 x 10' 2 

0.96 

3.1 x 10 -3 

1.3 x 10 _1 

0.34 

6.2 x 10 -3 

0.98 

5.3 x 10 -3 

0.97 

1.6 x 10" 3 

1.1 x 10" 1 

0.34 

3.2 x 10" 3 

0.96 

2.7 x 10" 3 

0.96 


Table 5: Rates of convergence for fi in dimension n = 3. 



(SI) 

(S2) 

(S3) 

Mesh size h 

goo E rror 

Order 

goo E rror 

Order 

goo E rror 

Order 

2.5 x 10" 1 

1.6 x 10" u 


4.0 x 10" 1 


3.1 x 10 _1 


1.3 x 10" 1 

1.2 x 10“° 

0.42 

3.9 x 10 _1 


3.8 x 10 _1 


6.3 x 10 -2 

6.9 x 10" 1 

0.79 

1.4 x 10' 1 

1.49 

1.1 x 10’ 1 

1.81 

3.1 x 10" 2 

5.3 x 10 _1 

0.37 

7.2 x 10~ 2 

0.93 

5.8 x 10' 2 

0.88 

1.6 x 10" 2 

4.3 x 10" 1 

0.30 

3.7 x 10" 2 

0.94 

3.0 x 10" 2 

0.96 

7.8 x 10" 3 

3.4 x 10" 1 

0.28 

1.9 x 10" 2 

0.98 

1.5 x 10" 2 

0.96 


Table 6: Rates of convergence for /2 in dimension n = 4. 


where k > 0. In the experiments, we set k = 20. The solution of (IP 1 1) is 


u 2 (x) 


1 

k + 1 


(xi ■■■x n ) 


n 


( U 

sin^Xj) 2 + nk 

V =1 


The level sets of u 2 are shown in Figure |2(b)| This case is interesting because the solution 
u 2 is smooth on (0, l] n , so we expect to see the formal rates of convergence for each scheme. 
Tables [5] and [6] show the £°° errors and orders of convergence in dimensions n = 2, n = 3, 
and n = 4. respectively. As expected, schemes (1S2[) and (IS3D show O(h) rates, while the rate 
for (ISljl appears to be approaching O(h^) as n increases. 

Finally, we consider a case where / is Lipschitz, and u has a gradient discontinuity, which 
is common in Flamilton-Jacobi equations due to crossing characteristics. In such a case, the 
solution u is not smooth, and so it is unclear a priori whether we will observe the formal or 
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(SI) 

(S2) 

(S3) 

Mesh size h 

goo £ rror 

Order 

£°° Error 

Order 

goo Error 

Order 

2.5 x 10" 2 

8.3 x 10" 2 


7.5 x 10~ 2 


3.1 x 10~ 2 


6.3 x 10 -3 

4.2 x 10 -2 

0.49 

1.9 x 10 -2 

1.00 

8.0 x 10 -3 

0.98 

1.6 x 10" 3 

2.1 x 10" 2 

0.50 

4.7 x 10" 3 

1.00 

2.0 x 10" 3 

1.00 

3.9 x 10 -4 

1.1 x 10" 2 

0.50 

1.2 x 10~ 3 

1.00 

5.0 x 10' 4 

1.00 

9.8 x 1(T 5 

5.3 x 10" 3 

0.50 

2.9 x 10~ 4 

1.00 

1.3 x 10' 4 

1.00 

2.4 x 10" 5 

2.7 x 10" 3 

0.50 

7.4 x 10" 5 

1.00 

3.1 x 10" 5 

1.00 


Table 7: Rates of convergence for f 3 in dimension n = 2. 



(SI) 

(S2) 

(S3) 

Mesh size h 

goo E rror 

Order 

g°o Error 

Order 

goo E rror 

Order 

5 x 10~ 2 

3.0 x 10" 1 


2.6 x 10" 1 


1.3 x 10 _1 


2.5 x 10" 2 

2.5 x 10" 1 

0.31 

1.3 x 10" 1 

0.96 

6.8 x 10" 2 

0.95 

1.3 x 10" 2 

2.0 x 10" 1 

0.32 

6.7 x 10~ 2 

0.99 

3.5 x 10~ 2 

0.97 

6.3 x 10" 3 

1.6 x 10" 1 

0.33 

3.3 x 10 -2 

0.99 

1.8 x 10' 2 

0.98 

3.1 x 10 -3 

1.2 x 10 _1 

0.33 

1.7 x 10 -2 

1.00 

8.8 x 10 -3 

0.99 

1.6 x 10" 3 

9.9 x 10" 2 

0.33 

8.4 x 10" 3 

1.00 

4.4 x 10" 3 

1.00 


Table 8: Rates of convergence for f 3 in dimension n = 3. 


theoretical rates. An example in this setting is 

u 3 (x) = n(x i • --Xn^wsix), 


where 

n 

w 3 (x) = C max{xi,..., x n } + Xj. 

3 = 1 

The corresponding right hand side of (IP1I) is 

^ n —1 

M®) = ir-L \n M®) + "C 1 + C ) 3: W) n ( W3 ( x ) + nx (*)) ■ 

^ i=l 

where x(i) = x^m for a permutation vr^ such that x(l) < x(2) < ■ ■ • < x(n). We set 
C = 10 in the experiments. Tables [3 [8] and [9] show the £°° errors and orders of convergence 
in dimensions n = 2, n = 3, and n = 4, respectively. We note that the formal rates of 
convergence are observed in this case for all schemes. 


The level sets of u 3 are shown in Figure 2(c) 
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(SI) 

(S2) 

(S3) 

Mesh size h 

1 °° Error 

Order 

i°° Error 

Order 

l°° Error 

Order 

2.5 x 10 _i 

8.5 x 10" 1 


1.4 x 10” u 


6.3 x 10” 1 


1.3 x 10 -1 

6.6 x 10 _1 

0.37 

7.7 x 10" 1 

0.84 

3.8 x lO” 1 

0.73 

6.3 x 10 -2 

5.5 x KT 1 

0.26 

4.1 x 10" 1 

0.89 

2.1 x 10" 1 

0.86 

3.1 x 10" 2 

4.6 x 10" 1 

0.25 

2.2 x 10” 1 

0.94 

1.1 x 10’ 1 

0.91 

1.6 x 10" 2 

3.9 x KT 1 

0.25 

1.1 x 10' 1 

0.98 

5.6 x 10~ 2 

0.96 

7.8 x 10" 3 

3.2 x KT 1 

0.25 

5.5 x 10" 2 

0.99 

2.8 x 10" 2 

0.99 


Table 9: Rates of convergence for fy in dimension n = 4. 

A Properties of finite differences 

We give the proof of Lemma [4.51 here. 

Proof. We proceed by induction. The base case of N = 2 is exactly Proposition 14.11 (ii). 
Assume (|4.8|) holds for some N > 2. Then by the inductive hypothesis and base case 

D^(ui ■ ■ ■ u N u N+ r) = («!••• u n )D^u n+ i + u N+ 1 D^(m ... u N ) ± hD^(ui ■ ■ ■ u N )D^u N+1 
N +1 N 


x D k u J n Ui + un + i ^2( ±h y 1 n °k ui n 

3 =1 i= 2 \I\=j 

± hD^{u\ ■ ■ ■ un)D^un+i- 


Ui 


Notice that 


= ±hD^U]y +1 


Ui 


±hD±(ui ■ ■ ■ un)D±un+i 

N N 

x D k u i n ui +x^)^ 1 x n ^ n 

^■=1 j =2 \I\=j i£l igl 

N N 

X ±hD±u N+ 1 D± Uj JJ Ui + ^(±M J D±u n+ i Y\ D± Ui 

j = 1 j — 2 \i\=j i&i 

N+l 

x^( ±/i ) j_i x n D h u * n^ 


3 = 2 


|/|=j ie/ 
Af+ie/ 


i<£I 


where in the hnal summation, I C {1,..., N + 1}. We also have 
N AM-1 

un+i ^(±/i) j_i j2 n D k u i n Ui =x ( ±/i ) j ” 1 x n n 


Ui 


3 =2 


|/|=j ie/ 


igj 


i=2 


|/|=j iei 
N+l&I 


i0 


Combining this with (IA.1I) and (1A.2I) we have 

AM-1 N+l 

D±(ui ■ ■ ■ unun + i) = x D t u 3 iwx ( ±h y 1 x n ^n 

i =1 #3 3 =2 |/|=J *6/ 

This verifies (14.811 for IV + 1. The proof is completed by mathematical induction. 


Ui 


(A.l) 


(A.2) 


□ 
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